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ABSTRACT 



This report presents the findings of a survey designed to 
gather information about the experiences and attitudes of students enrolled 
in developmental English courses at Northern Virginia Community College 
(NVCC) . The primary purpose of the study was to find out how satisfied 
students were with their experiences related to their English placement 
testing and course work in developmental English at NVCC during the fall 2000 
semester. The study also sought information about the respondents' academic 
preparation prior to beginning the fall 2000 semester at NVCC. The 
respondents were students who did not return for the spring 2001 semester. 
They were asked to self-rate their pre-enrollment English skills and their 
study skills and to describe how they had performed in high school. 

Highlights include: (1) 85% of respondents surveyed agreed or strongly agreed 

with the college's recommendation that they take the English placement test; 
(2) 80% agreed or strongly agreed that the preparation material provided by 
the testing center gave them adequate information about the test; (3) 80% 

said that instructors adapted to their individual needs; and (4) 72% planned 

to return to NVCC. Many of the reasons given for withdrawal were personal, 
such as work schedule conflicts, lack of time to study, and lack of 
transportation. (Contains 25 tables.) (NB) 
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NON-RETURNING DEVELOPMENTAL ENGLISH STUDENTS 

AT NVCC: FALL 2000 



Executive Summary 

This report presents the results of a telephone survey that was conducted to gather information 
about the experiences and attitudes of students enrolled in developmental English courses at 
Northern Virginia Community College (NVCC) in fall 2000. The respondents were students who 
did not return to NVCC for the spring 2001 term. The Office of Institutional Research (OIR) at 
NVCC conducted the telephone surveys during the spring 2001 semester. The primary goals of 
the study were to find out what the respondents thought about the English placement testing 
process, how satisfied they were with their placement, and how beneficial they found the 
courses that they took in developmental English. Information was also obtained about their 
academic performance prior to enrollment, why they chose NVCC, and what their education 
goal had been at the time of enrollment. Finally, in addition to being asked whether they 
planned to return to NVCC, the respondents were asked about their opinion on mandatory 
testing and on mandatory placement for new students at NVCC. 

The following is a summary of the study’s key findings. 



Satisfaction with the Testing Process 

• A large majority of the respondents (85%) said that they agreed with the recommendation to 
take an English placement test. 

• Eighty percent (80%) of the respondents thought that preparation material provided by the 
Testing Center was adequate, and nearly two-thirds of respondents said that they received 
adequate pre-test guidance and counseling. 

• A large majority of respondents (84%) agreed or strongly agreed that they were generally 
comfortable about the test procedure. 

• More than a fourth of the respondents (28%) said that they would have preferred taking a 
paper and pencil test rather than the computer-based test. 

• Respondents were about evenly divided between those who found some areas of the test 
challenging and those who did not. 

• Slightly more than two-thirds of the respondents, when asked their overall perception of the 
test, said that the test met their standards. Ten percent of the respondents said that the test 
was too easy, while 11% said that it was too hard. 
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Satisfaction with Placement 



• Nearly all of the respondents said that they understood how the test report that they 
received after the test should be used and that they understood the prerequisites they 
needed for the English courses that they wanted to take. 

• Slightly more than half of the respondents said that they had helpful counseling and/or 
advice after the English placement test. 

• About two-thirds of the respondents stated that they were comfortable with the fact that the 
school placed them in a developmental English course. 

• Twenty-seven percent of respondents felt that they were placed in a developmental English 
course that was too easy for them, while 18% said their developmental English course was 
too difficult. 

Satisfaction with the Course and the Instructor 

• Approximately two-thirds of respondents found the developmental English course in which 
they were placed useful. About a quarter of the respondents did not. 

• The vast majority of respondents termed their instructors as effective or very effective. 

• About three-fourths of the respondents felt that the instructor adapted to their individual 
needs in the developmental English course and that the instructor spent enough time with 
them both in and out of the classroom. 

• Writing centers were the most frequently mentioned service used by those who took 
advantage of one or more of the College’s support services. 

• Eighty-eight percent of the respondents said that the class size in their developmental 
English course was comfortable. 

Pre-Enrollment Attributes of Respondents 

• On a scale of 0 - 10, 15% of the respondents rated their pre-enrollment English skills in the 
middle of the scale (5). More than three-fourths of the respondents rated their English skills 
as 6 or higher, while only a very small percentage (7%) rated their skills as 4 and under. 

• Well over half of the respondents considered their study skills as good to excellent. 
However, slightly more than a quarter of the respondents considered their study skills as 
only fair or poor. 

• About half of the answers respondents gave to describe their academic performance in high 
school were categorized as “Good.” 



Outcomes, Reasons for Enrolling, and Plans to Return 

• Over half of the respondents to the survey (58%) finished the fall 2000 semester at NVCC. 
Of those respondents who withdrew, more of them withdrew around mid-semester time than 
in the first week or two of the semester. 

• The largest proportion of respondents expressed their educational goal in terms of interest 
in a specific academic or occupational program offered by NVCC. Like the goals in some of 
the other categories, these goals appeared to be ones that would have required students to 
attend college for more than one semester. 

• Many more respondents indicated that their motivation for choosing NVCC was due to 
personal interest or their parents than because of their employer or job. 

• Most respondents said that there was nothing the school might have done to keep them 
enrolled for the spring term. Many explained that their reasons for not returning were not 
school related or related to any dissatisfaction with NVCC. 

• Some respondents indicated that dissatisfaction with their developmental English 
experience contributed to their not returning. 

• A large majority (73%) of respondents indicated that they plan to return to NVCC, while 13% 
said that they would not. Fourteen percent were undecided. 

Respondents’ Suggestions for Changing Developmental English 

• Over half of the respondents offered suggestions for changing developmental English. 

• The suggestions for changes fell into two main groups: those having to do with testing and 
placement policies and those having to do with the developmental English course itself. 

Respondents’ Opinions on Mandatory Testing and on Mandatory Placement 

• Seventy-nine percent of the respondents thought that all new students enrolling at NVCC 
should be required to take an English placement test. Just 17% said that they do not think 
new students should be required to take an English placement test. 

• A much smaller proportion of the respondents (54%) thought that there should be 
mandatory placement for new students who take the English placement test. 
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NON-RETURNING DEVELOPMENTAL ENGLISH STUDENTS 

AT NVCC: FALL 2000 



Introduction 



This report presents the findings of a survey designed to gather information about the 
experiences and attitudes of students enrolled in developmental English courses at Northern 
Virginia Community College (NVCC) in fall 2000. The respondents were students who did not 
return for the spring 2001 semester. The survey, which was administered by the Office of 
Institutional Research (OIR), was conducted by telephone in the spring 2001 semester. 

Research shows that not all underprepared students can be expected to succeed at the same 
rate. Clifford Adelman, a senior researcher at the U.S. Department of Education, has 
demonstrated an inverse relationship between the extent of remediation a student needs and 
the student’s completion of a degree. Moreover, Adelman has shown that “when reading is at 
the core of the problem, the probability of success in college is lower.” 1 Overall, however, 
underprepared students who enroll in developmental courses increase their chances of success 
in college. 

Like other community colleges, NVCC offers developmental English courses to students whose 
placement testing indicates a need to build up their reading and writing skills before enrolling in 
college-level courses. Students who fail to earn a qualifying score on the English placement 
test administered by the College must enroll in one or more developmental English courses as 
prerequisites for enrollment in some college-level courses, including English. Students whose 
test scores fall below the qualifying mark on the English placement test are advised as to which 
of the six different developmental English courses offered by NVCC they should complete to 
better prepare themselves for success in college-level courses. 

The primary purpose of the study was to find out how satisfied respondents were with their 
experiences related to their English placement testing and course work in developmental 
English at NVCC during the fall 2000 semester. A further purpose of the study was to 
determine respondents’ attitudes toward testing and placement before and after their enrollment 
in developmental English courses. To those ends, participants in the survey were asked about: 

• how comfortable they were with the testing and placement process, 

• what they thought about the English placement test, 

• what they thought about their placement in developmental English courses, 

• their level of satisfaction with their developmental English courses, 

• how effective they found their instructors, and 

• whether or not they had completed the fall 2000 term at NVCC. 



Besides finding out what respondents thought about their testing, placement, and course work 
in developmental English, the study also sought information about the respondents’ academic 
preparation prior to beginning the fall 2000 semester at NVCC. Respondents were asked to 



1 Quoted in College Remediation: What It Is, What It Costs, What’s at Stake, by Ronald Phipps. Washington, D.C.: 
The Institute for Higher Education Policy, 1998, p. 1 1 . 
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self-rate their pre-enrollment English skills and their study skills and, in addition, to describe how 
they had performed academically in high school. 

Respondents were also questioned about their educational goal at the beginning of the fall term, 
their motivations for choosing NVCC, whether NVCC might have done anything to help them 
continue, and whether they planned to return to NVCC. 

At the end of the survey, respondents were asked to state their opinion of whether English 
testing and placement should be mandatory for new students at NVCC. 

Students who had taken developmental English courses at each of NVCC’s five campuses 
during fall 2000 and who had not returned for spring 2001 were randomly selected to answer 
the survey’s combination of 28 closed and open-ended questions. The sample size varied 
because of changes in the number of students responding to each question. Since the 
responses to each question were analyzed separately, variations in the sample size did not 
affect the data results. Respondents were encouraged to offer comments during the course of 
the interview and at its conclusion. About 20% of the students who were enrolled in 
developmental English courses during fall 2000 and who did not return for spring 2001 
participated in the survey. 

The report is divided into seven sections: 

• Section 1 analyzes the survey results related to respondents’ satisfaction with the English 
placement test and with testing procedures. 

• Section 2 summarizes the results related to how satisfied respondents were with their 
placement in developmental English courses. 

• Section 3 reports on what respondents thought about the developmental English courses 
that they took and how effective they found their instructors. 

• Section 4 provides a look at how respondents rated their pre-enrollment English skills, their 
study skills, and their academic preparation in high school. 

• Section 6 presents the ideas of respondents who made suggestions for changes in English 
testing and placement or in developmental English courses. 

• Section 7 summarizes respondents’ views on mandatory testing and mandatory placement. 
A brief discussion of research related to mandatory testing and placement concludes the 
section. 

Within each section of the report, questions are included in the analysis for the purpose of 
triggering thought or discussion. The questions are not meant to be considered the only ones 
that might be raised in considering the study’s findings, nor is it suggested that these questions 
have never been previously considered by the College. 
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Section 1 : Satisfaction with the Testing Process 

Section 1 looks at the results of questions aimed at finding out what respondents thought about 
taking an English placement test, how satisfactory they found the procedures for taking the test, 
whether or not they received adequate guidance and advice before and after the test, and what 
they thought of the test itself. 

Agreement with Taking the English Placement Test 

First-time college students enrolling at NVCC are advised to take placement tests to determine 
their proficiency in English. Students’ scores on the English placement test determine whether 
they will be required to complete a course or courses in developmental English as prerequisites 
to enrolling in many of the College’s credit-bearing courses, including college-level English 
courses. 

When respondents to the survey were asked whether they agreed or disagreed with the 
College’s recommendation to take an English placement test, the majority (85%) said that they 
agreed or strongly agreed with being advised to take the test (Table 1). Specifically, 27% of the 
respondents answered “Strongly agree.” In contrast, only 6% of the respondents answered 
“Strongly disagree.” 

Table 1: Agreement with Taking the English Placement Test 



Did You Agree with the Decision to Take 
the English Placement Test? 


Responses 


# 


% 


Strongly agree 


45 


27.4 ; 


Agree 


95 


57.9 


Disagree 


15 


9.2 


Strongly disagree 


9 


5.5 


Total 


164 


100.0 



Adequacy of Test Preparation Material 

Respondents were next asked whether the preparation material provided by the Testing Center 
prior to their taking the English Placement Test gave them adequate information about the test. 
Table 2 shows that 80% of the respondents agreed or strongly agreed that the preparation 
material was adequate, while only 20% of the respondents disagreed or strongly disagreed that 
it was adequate. 

In addition to indicating whether they agreed or disagreed that preparation material was 
adequate, some respondents volunteered that they knew nothing about the English placement 
test until they went to register. One respondent stated that she felt “blindsided” by lack of 
advance information about testing. Others noted that they were not aware that results of the 
test might mean placement in English classes where they would not earn college or transfer 
credit. A few respondents said that they might have taken the test more seriously if they had 
known the consequences, and several said that they were surprised to learn after taking the test 
that they could not re-take it for a year. 
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While the great majority of respondents thought that the preparation material was adequate, the 
finding that one in every five respondents did not agree suggests that procedures for making 
test information available to students may need to be reviewed. Some questions for review 
might include: What kind of information about the English placement test at NVCC is available 
to prospective students? Do most prospective students know they can find information and 
sample test items on NVCC’s web site? How far in advance of the test should students obtain 
information? 

Table 2: Adequacy of Preparation Material Provided by the Testing Center 



Preparation Material Gave Adequate 
Information about the Test 


Responses 


. 


: % 


Strongly agree 


39 


23.3 


Agree 


94 


56.3 


Disagree 


32 


19.2 


Strongly disagree 


2 


1.2 


Total 


167 


100.0 



Adequacy of Pre-Test Guidance and Counseling 

When asked about the adequacy of pre-test guidance and counseling, nearly two-thirds of 
respondents (64%) agreed or strongly agreed that they received adequate pre-test guidance 
and counseling. However, slightly more than a third of respondents (36%) said that they 
disagreed or strongly disagreed that their pre-test guidance and counseling was adequate 
(Table 3). 

Some respondents commented that they had received helpful advice about the test or a clear 
explanation of how the results would be used to help place them in an appropriate English 
course. Some respondents characterized the help they received as adequate but minimal, one 
saying that “some lady” simply told him, “Here’s the test, there’s the computer.” A few 
respondents claimed that they received little or no guidance or counseling, such as the one who 
said that he thinks that English placement should be “more of a personal process rather than a 
computer telling students what to take.” 

Although nearly two-thirds of the respondents felt that pre-test guidance and counseling was 
adequate, the finding that one in three respondents did not consider it adequate suggests that 
not all students may have received the help they needed. Some questions for the College to 
review might include: Are students taking advantage of the information and help currently 
available to find out what they need to know prior to taking the placement test? If not, how can 
they be guided to do so? How can the College ensure that students receive the right 
information at the right time? 
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Table 3: Adequacy of Pre-Test Guidance and Counseling 



Pre-Test Guidance and 


Responses 


Counseling Was Adequate 


SI tMMMB 


% 


Strongly agree 


31 


19.2 


Agree 


72 


44.4 


Disagree 


53 


32.7 


Strongly disagree 


6 


3.7 


Total 


162 


100.0 



Comfort with the Test Procedure 

When asked about their degree of comfort with the test procedure, the majority of respondents 
(84%) said that they agreed or strongly agreed with the statement, “I was generally comfortable 
about the test procedure” (Table 4). Approximately 16% of the respondents either disagreed or 
strongly disagreed with the statement that they were comfortable with the test procedure. 

Most respondents did not elaborate on their reasons for discomfort with the test procedure, but 
one reason given by a number of respondents was that they were “just not good test takers." 
Respondents giving this answer tended to bring up the same point in replying to other 
questions, often suggesting that a testing situation may not be a true measure of their abilities. 
A question raised by this finding is whether or not students who claim they are not good test 
takers should be encouraged to speak to a counselor before testing to find out if anything can 
be done to increase their chances for success. 

Table 4: Comfortable with the Test Procedure 



Generally Comfortable About 
the Test Procedure 


Responses 


# 


% 


Strongly agree 


39 


23.8 


Agree 


99 


60.4 


Disagree 


21 


12.8 


Strongly disagree 


5 


3.0 


Total 


164 


100.0 



Preference for Paper and Pencil vs. Computer-Based Test 

Since the English placement test is generally administered on a computer, respondents were 
asked whether or not they would have preferred a paper and pencil test. More than a fourth of 
survey respondents (28%) expressed a preference for paper and pencil, answering “Agree” or 
“Strongly Agree” (Table 5). In contrast, the majority of respondents (72%) said that they 
disagreed or strongly disagreed with the statement, sometimes adding that the computer was 
“no problem” or that they preferred the computer. 

Of the more than one in four respondents who said that they would have preferred paper and 
pencil, many seemed to feel strongly on the issue, whereas students who did not indicate a 
preference for paper and pencil were more apt to say that they “didn’t mind” the computer or 
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that doing it on the computer was “O.K.” One respondent commented that while he didn’t prefer 
paper and pencil, he found having to scroll up and down to complete some portions of the test 
“quite annoying.” Another said that had she been working on paper, she might have caught 
some of her errors, but that working on the computer “made her go too fast.” One respondent 
suggested that students should be given a chance to practice on the computer before taking the 
test. 

How should NVCC respond to the finding that slightly more than one in four students expressed 
a preference for a paper and pencil test? Should students be given a choice between a paper 
and pencil vs. computer-adapted test before taking it? Are there drawbacks or increased costs 
associated with offering paper and pencil tests that must be considered before giving students a 
choice? 



Table 5: Preference for Paper and Pencil Test 



1 Would Have Preferred a 
Paper and Pencil Test 


Responses 


# 


% 


Strongly agree 


31 


19.1 


Agree 


15 


9.3 


Disagree 


72 


44.4 


Strongly disagree 


44 


27.2 


Total 


162 


100.0 



Challenging Areas of the Test 

When asked whether they found any areas of the English placement test particularly 
challenging, respondents were about evenly divided between those who did and those who did 
not. As shown in Table 6, about 46% indicated that they had found some areas of the test 
challenging, while approximately 50% of the respondents said they had not. Others said that 
they did not remember if any parts of the test were challenging. 

Of the respondents who answered “Yes” to the question of whether or not they found any areas 
of the English placement test challenging, a small number of them identified which areas they 
found challenging. Grammar, writing, and reading were the areas mentioned most frequently by 
respondents. Another area mentioned as particularly challenging included a section where 
underlined sentences in paragraphs had to be corrected. 

Some of the respondents’ comments in response to this question indicated not so much 
difficulty with the content of the test as with using the computer for the test or confusion about 
what they were supposed to do. One respondent mentioned that she did not know whether she 
could ask questions once she began the test (so she didn’t), and another noted that she had no 
chance to practice on the computer before testing, even though she asked to do so. 
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Table 6: Challenging Areas of the English Placement Test 



Did You Find Any Areas of the 
Test Particularly Challenging? 


Responses 


# 


% .... 


Yes 


86 


46.0 


No 


92 


50.0 


Don’t remember 


8 


4.0 


Total 


186 


100.0 



Overall Perception of the Test 

In addition to being asked about any areas of the English placement test that they might have 
found particularly challenging, respondents were asked to indicate their overall perception of the 
test by choosing from the responses shown below in Table 7. The most frequently given 
response was that the test met their standards (68%). Much lower proportions of respondents 
thought that the test was either too easy or too hard. About the same percentage of 
respondents thought that the test was too easy (10%) as those who thought that it was too hard 
(11%). Eleven percent of the respondents either did not remember the test well enough to 
comment or didn’t take the test. 



Table 7: Perception of the English Placement Test 



What Was Your Perception of 
the English Placement Test? 


Responses 


# 


% 


Too easy 


15 


10.1 


Too hard 


17 


11.4 


Met standards 


101 


67.8 


Can’t remember 


7 


4.7 


Didn’t take test 


9 


6.0 


Total 


149 


100.0 
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Section 2: Satisfaction with Placement 



Section 2 describes how comfortable participants were with their placement in developmental 
English courses and whether or not the courses were appropriate to their level. 



Understanding of the Use of the Test Report 

It is important that students who take the English placement test at NVCC understand their test 
results and how those results are used to make placement decisions. When asked, the majority 
of the respondents (91%) agreed or strongly agreed with the statement, ”1 understood how the 
test report should be used.” As shown in Table 8, a total of 9% of the respondents indicated 
that they did not understand how the test report should be used. 



Table 8: Understanding of the Use of the Test Report 



1 Understood How the Test 


Responses 


Report Should Be Used 


# 


% 


Strongly agree 


40 


24.4 


Agree 


109 


66.5 


Disagree 


13 


7.9 


Strongly disagree 


2 


1.2 


Total 


164 


100.0 1 



Understanding of Prerequisites for English Courses 

The majority of respondents (92%) also indicated that they understood which developmental 
courses were prerequisites for the English courses that they wanted to take (Table 9). Less 
than 1% said that they “Strongly disagreed” with the statement regarding prerequisites, and 
another 8% said they disagreed. 



Table 9: Understanding of Prerequisites 



1 Understood the Prerequisites 
Needed for English Courses 


Responses 


# 


% 


Strongly agree 


50 


29.9 


Agree 


103 


61.7 


Disagree 


13 


7.8 


Strongly disagree 


1 


0.6 


Total 


167 


100.0 ! 
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Helpfulness of Counseling after the Test 



Students whose English placement test scores fall below the cutoff point for enrolling in college- 
level English courses must complete one or more developmental English courses before taking 
college-level English courses. After receiving their test scores, they are advised to confer with a 
counselor about what courses would be most appropriate for them. Respondents were asked 
about the helpfulness of the counseling that they received after taking the test. 

Just over half of the survey respondents (54%) agreed or strongly agreed with the statement, “I 
had helpful counseling and/or advice after taking the English placement test.” Thirteen percent 
said that they strongly agreed with the statement and 41% said that they agreed (Table 10). Of 
the 46% who disagreed with the statement, 10% answered “Strongly disagree.” 

Given that post-test counseling can be assumed to have played a role in students’ 
understanding of their test report and which prerequisites they needed to qualify for college- 
level English courses, the finding that nearly half of the respondents did not consider their post- 
test counseling or advice helpful is puzzling. Is it possible that while they understood the 
information they received, many were disappointed or upset by their test results, causing them 
to feel a need for more support than is generally offered? Are College personnel trained to deal 
any differently with students who do not earn a qualifying score on the English placement test 
than with those who do? 



Table 10: Helpfulness of Counseling After the Test 



1 Had Helpful Counseling 
and/or Advice After the Test 


Responses 


i i# 


% 


Strongly agree 


22 


13.3 


Agree 


68 


41.0 


Disagree 


59 


35.5 


Strongly disagree 


17 


10.2 


Total 


166 


100.0 



Comfort with Placement in Developmental English 

Respondents to the survey were next asked whether they were comfortable with being placed in 
a developmental English course. Approximately two-thirds of the respondents answered 
affirmatively when asked, “After you were counseled about your test results, were you 
comfortable with the fact that the school placed you in a developmental English course?” (Table 
11). 
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